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SEMIDEFINITE PROGRAMMING RELAXATIONS FOR LINEAR 
SEMI-INFINITE POLYNOMIAL PROGRAMMING 


FENG GUO 


Abstract. This paper studies a class of so-called linear semi-infinite polyno¬ 
mial programming (LSIPP) problems. It is a subclass of linear semi-infinite 
programming problems whose constraint functions are polynomials in param¬ 
eters and index sets are basic semialgebraic sets. When the index set of an 
LSIPP problem is compact, a convergent hierarchy of semidefinite program¬ 
ming (SDP) relaxations is constructed under the assumption that the Slater 
condition and the Archimedean property hold. When the index set is non¬ 
compact, we use the technique of homogenization to equivalently convert the 
LSIPP problem into compact case under some generic assumption. Conse¬ 
quently, a corresponding hierarchy of SDP relaxations for noncompact LSIPP 
problems is obtained. We apply this relaxation approach to the special LSIPP 
problem reformulated from a polynomial optimization problem. A new SDP 
relaxation method is derived for solving the class of polynomial optimization 
problems whose objective polynomials are stably bounded from below on non¬ 
compact feasible sets. 


Key words linear semi-infinite programming, semidefinite programming relax¬ 
ations, sum of squares, polynomial optimization 

1. INTRODUCTION 

We consider the following linear semi-infinite polynomial programming (LSIPP) 
problem 

f p* := inf c^x 

(1.1) (P) 

s.t. a{y)'^x -h b{y) >0, Vp C 5 C E^, 

where c € E^, b{Y) G E[y] := E[Fi,...,W] the polynomial ring in Y over the 
real field, a{Y) = (ai(y),..., am(L"))^ C E[y]”^, and the index set 5 is a basic 
semialgebraic set defined by 

(1-2) 5:={yCE-|pi(y)>0,...,p,(y)>0}, 

where gj{Y) G M[F], j = 1,..., s. In this paper, we assume that Ci is feasible and 
bounded from below, i.e., —oo < p* < oo. Note that the problem is NP-hard. 
Indeed, it is obvious that the problem of minimizing a polynomial f(Y) € K[Y] 
over S can be regarded as a special LSIPP problem (see Section]^. As is well 
known, the polynomial optimization problem is NP-hard even when n > 1, f{Y) 
is a nonconvex quadratic polynomial and gj{Yys are linear |23j . Hence, a general 
LSIPP problem can not be expected to be solved in polynomial time unless P=NP. 

LSIPP can be seen as a special branch of linear semi-infinite programming 
(LSIP), or more general, of semi-infinite programming (SIP), in which the involved 
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functions are not necessarily polynomials. Due to its many applications and ap¬ 
pealing theoretical properties, SIP has become an independent and active research 
area since 1960s and a large amount of work has been done on it. Numerically, SIP 
problems can be solved by different approaches including, for instance, discretiza¬ 
tion method, local reduction method, exchange method, simplex-like method and 
so on. See the surveys [3 El H [in [Ml Ea ED] and the references therein for details. 
To the best of our knowledge, few of them are specially designed by exploiting 
features of polynomial optimization problems. Parpas and Rustem [53] proposed 
a discretization-like method to solve min-max polynomial optimization problems, 
which can be reformulated as semi-infinite polynomial programming (SIPP) prob¬ 
lems. Using polynomial approximation and an appropriate hierarchy of semidefinite 
programming (SDP) relaxations, Lasserre presented an algorithm to solve the gen¬ 
eralized SIPP problems in M- Based on exchange scheme, an SDP relaxation 
method for solving SIPP problems was proposed in |33j . By representations of 
nonnegative polynomials in the univariate case, an SDP method was given in |35j 
for LSIPP problems (1.1) with S being closed intervals. 

One of the difficulties in solving general SIP problems is the feasibility test of u G 
which is equivalent to solve the problem of minimizing the constraint function 
with fixed u over the index set. For SIPP or LSIPP problems, it is equivalent to 
a global polynomial optimization problem. Due to representations of nonnegative 
polynomials as sums of squares and the dual theory of moments, a hierarchy of SDP 
relaxations can be constructed to approximate polynomial optimization problems, 
see m [13 H E5] and the references therein. More precisely, we associate the 
set S with a so-called quadratic module which is a set of polynomials generated 
by gj{Yys. If the Archimedean property (Definition 2.3) holds, then Putinar’s 
Positivstellensatz (53 states that any polynomial positive over S belongs to the 
quadratic module. According to Schmiidgen’s Positivstellensatz [29] , if ^ is compact 
but the Archimedean property fails, we can replace in the above statement the 
quadratic module by the preordering generated by gj{Yys. These representations of 
positive polynomials can be reduced to SDP feasibility problems. An SDP problem 
can be solved by interior-point method to a given accuracy in polynomial time 
[32l [34] . For this reason, it inspires us to investigate an SDP relaxation approach 
for solving the LSIPP problem 

Contribution. The main contribution of this paper is the following. 

(i) We first consider the case when S is compact. By adding a redundant in¬ 
equality in the description of S, we always assume that the Archimedean prop¬ 
erty is satisfied. When the Slater condition (Definition 2.1) holds for ([TtJ which 
is commonly assumed in the literature on SIP, we show that the constraint that 


a{yy X b{y) > 0 on S can be replaced by that the polynomial a{Yy 


b{Y) 


belongs to the quadratic module associated with S. Then, a convergent hierarchy 
of SDP relaxations is constructed for (1.1). Thus, a decreasing sequence of upper 
bounds convergent to p* can be computed. The practical importance of these up¬ 
per bounds is that by combining the lower bounds of p* gained by, for instance, 
discretization methods, a desired £-optimal solution of (O) can be obtained. 

(ii) We say that the finite convergence of the proposed SDP relaxations occurs 
if the optimal value of the SDP relaxation of some finite order equals p*. We prove 
that a rank condition on the dual moment matrices of the SDP relaxations can be 
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used for certifying the finite convergence. We point out that this is only a sufficient 
condition which means that it might not hold when the finite convergence happens, 
(iii) When S is noncompact, the Archimedean property fails. We use the ho¬ 


mogenization technique to equivalently convert (1.1) into compact case under some 


generic assumption. Here, the generality means that the assumption holds if the 
coefficients of the polynomials gj in the description of S are in general (see Remark 
3.17). Consequently, a hierarchy of SDP relaxations of (1.1) with noncompact index 


set S is derived. 

(iv) We apply this relaxation approach to the special LSIPP problem refor¬ 
mulated from a polynomial optimization problem. When the feasible set of the 
polynomial optimization problem is compact, we get the classic Lasserre’s SDP re¬ 
laxation method. When the feasible set is noncompact, a new and efficient SDP 
relaxation approach is obtained for solving the class of polynomial optimization 
problems whose objective polynomials are stably bounded from below on noncom¬ 
pact feasible sets. Note that the classic Lasserre’s SDP relaxation method might 


fail for this class of problems, see Example 4.6 


This paper is organized as follows. We introduce some notation and preliminaries 
in Sectionj^ Depending on whether S is compact or not, two SDP relaxation meth¬ 
ods and a stopping criterion are proposed in Section]^ for (1.1). In Sectionwe 
consider the application of the proposed relaxation approach to the special LSIPP 
problem reformulated from a polynomial optimization problem. A conclusion is 
made in Section [S] 


2. Notation and Preliminaries 


Here is some notation used in this paper. The symbol N (resp., M) denotes the 
set of nonnegative integers (resp., real numbers). For any t G K, [t] denotes the 
smallest integer that is not smaller than t. For y = {yi ,..., y^) G M", \\y \\2 denotes 
the standard Euclidean norm of y. For a = (oi, ...,«„) G N”, ||q!||i = ai-)-• • - -ban- 
For fc G N, denote = {a G N” | ||a||i < k}. For y G K" and a G N", denotes 
Vi^ • • ■ y“". • • • , Yn] denotes the ring of polynomials in (Fi, • • • , F„) 

with real coefficients. For fc G N, denote by K[F]fc the set of polynomials in K[F] 
of total degree up to k. For a symmetric matrix W, W >: 0(;^ 0) means that W is 
positive semidefinite (definite). For two symmetric matrices A, B of the same size, 
{A,B) denotes the inner product of A and B. 

For any feasible point x G K™ of (1.1), the active index set of x is 

{y G S' I a{yf'x + h{y) = 0}. 


The Haar dual problem [T] of 


IS 


( 2 . 1 ) 


(D) 


:= sup - V Xyb{y) 


v&S 


s.t. V Aya(y) = c. 


y&S 


Xy > 0, Vy G S, 


where only finitely many dual variables Xy, y G S, take positive values. 


Definition 2.1. We say that Slater condition holds for the problem (1.1) if there 
exists X G K”’' such that a{y)'^x + b{y) > 0 for all y G S. 
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Proposition 2.2. [TU Theorem 6.9] If S is compact and Slater condition holds for 
(1.1), then p* = d* and d* is attainable. 

Next we recall some background about sums of squares of polynomials and the 
dual theory of moment matrices. For any f{Y) S K[y]fc, let f denote its column 
vector of coefficients in the canonical monomial basis of R[F]fc. A polynomial 
fix) € K[F] is said to be a sum of squares of polynomials if it can be written as 
fX) = 111=1 fiXY for some fiX), ■ ■ ■, ftX) ^ The symbol denotes 

the set of polynomials that are sums of squares. 

Let G := {gi, ..., be the set of polynomials that defines the semialgebraic 
set S (|1.2|). We denote 


Q(G) := 

1=0 


go = 1, cTj G SNj = 0,1, 


1=0 


as the quadratic module generated by G and its k-ih. quadratic module 

go = 1, (Tj G deg(crjgj ) < 2fc, j = 0,1,..., 

It is clear that if / G Q(G), then /(g) > 0 for any y G S. However, the converse is 
not necessarily true, see Example 3.12 Note that checking / G Qk{G) for a fixed 
fc G N is an SDP feasibility problem |12[ E5] . 

For fc G N, denote s{k) := A sequence of real numbers z := G 

Igs(2fc) -whose elements are indexed by n-tuples a G is called a truncated moment 
sequence up to order 2k. We say that z G has a representing measure p if 


= I y“d/4(g), Va G NX 


The associated fc-th moment matrix is the matrix Mfc(z) indexed by with {a, /?)- 
th entry Za+p for a,/3 G N^. Given a polynomial fX) = J2a for k > df := 

[deg(/)/2], the {k — dj)-th localizing moment matrix M^-dfifz) is defined as the 
moment matrix of the shifted vector ((/2)ct)aGNj(j, ^ , with (/z)^ = Up fp^a+p- 
.Jfik denotes the space of all truncated moment sequences with order at most 2k. 
For any z G the Riesz functional on K[F] 2 fe is defined by 

ifz [^ qoYX ■ ■ ■ YX ) := E e Km2fc. 

\ a / Oi 

From the definition of the localizing moment matrix Mk-df ifz), it is easy to check 
that 

(2.2) q^Mfc_,^(/z)q = if,(/(y)g(r)^), Vg(y) G 

Let dj := |■deg(gJ)/2] for each / = 1,..., s. For any v G S, let f 2 k,v ■= KjaGNj,, 
be the Zeta vector of v up to degree 2k, i.e., 

C2fc.-« = [1 Vi ••• Vn vl ViV2 ■■■ 

Then, Mk{C 2 k,v) h 0 and {gjC 2 k,v) ^ 0 for j = 1,..., s. In fact, let go = 1, 

then for each j = 0,1,..., s, 

qlMk-d,{gjC 2 k,vX = ■^C2k,A9jiY)qXX) = 9 jXq{vf > o, Vg(r) g M[r]fc_d,. 
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Definition 2.3. We say that Q{G) is Archimedean if there exists if G Q(G) such 
that the inequality ipiy) > 0 defines a compact set in R”. 

Note that the Archimedean property implies that S is compact but the converse 
is not necessarily true. However, for any compact set S we can always force the 
associated quadratic module to be Archimedean by adding a redundant constraint 
M — II 2 /II 2 > 0 in the description of S for sufficiently large M. 

Theorem 2.4. [5S1 Putinar’s Positivstellensatz] Suppose that Q(G) is Archimedean. 

(i) If a polynomial p G M[y] is positive on S, then p G Qk(G) for some k G N; 

(ii) If Mk{z) >: 0 and Mk{gjz) ^ 0 for all j = 1 , s, and all fc = 0, 1 , .. then 
z has a representing measure p. with support contained in S. 


3. SDP RELAXATIONS OF LSIPP 


In this section, depending on whether the index set S is compact or not, we 
shall construct two hierarchies of SDP relaxations and provide a sufficient stopping 


criterion when the finite convergence occurs for solving the LSIPP problem (1.1). 


3.1. Compact case. We assume that S in (1.1) is compact. 


3.1.1. SDP relaxations of compact LSIPP problems. For a given feasible point 
X G M™ of the LSIPP problem (1.1), the constraint requires that the polynomial 
aiXY^x + h{Y) G M[y] is nonnegative on S. Since every polynomial in the quadratic 
module Q{G) of S generated by G is nonnegative on S, we can relax the problem 
(1.1) as follows 

c^x s.t. a{Yfx + h{Y) G Q{G). 


(3.1) 


P 


:= inf 

xG'R^ 


Clearly, any feasible point of (3.1) is also feasible for (1.1). Hence, we have > p*. 


Theorem 3.1. If Q{G) is Archimedean and Slater condition holds for the LSIPP 
problem (1.1), then p’'°'‘ = p* ■ 


Proof. Fix an e > 0 and a feasible x G K"(_of (1.1) such that a{y)'^x + b{y) > 0 
for all y G S. Since S is compact and (1.1) is linear, we have c^x — p* >0. 
Hence, we can fix another feasible point x' G R™ of (1.1) such that c'^x > cFx' and 
c^x' — p* < e/2. Let 


<5 := 


2c^{x — x') 


- > 0 and X •.= {1 — 5)x' + 5x. 


Then 


a{y) x + h{y) = {I-5)[a{y) x'+ b{y)] + 5[a{y) x + b{y)]>0, Wy G S. 

Since Q{G) is Archimedean, a{Y)'^x + b(Y) G Q{G) by Putinar’s Positivstellensatz. 
That is, X is feasible for both and (|3.1[). We have 


— p* < c X — p* 

= (1 — S)c'^x' + Sc^x — p* 
= {(F x' — p*) + 5c^{x — x') 


e s 

<2 + 2 ="- 


Since e > 0 is arbitrary and > p*, we conclude that = p*. 


□ 
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(3.2) 


Note that we do not require that p* is attainable in the above proof. Define 
dj := \deg{gj)/2\, ds := maxjl,di,...,dj, 
dp := inax{ds, |■deg(al)/2], • • • , |■deg(a™)/2], |■deg(5)/2]}. 


For k > dp, replacing Q{G) in (3.1) by its fc-th truncation Qk{G), we obtain 


(3.3) 


pr := inf G x 


s.t. a{Yfx + h(Y)=Y,a,{Y)g,{Y), 
j=o 

go = 1, aj e deg{ajgj) <2k, j = 0,...,s. 


Now we reformulate (3.3) as an SDP problem. For any t € N, let mt(Y) be the 
column vector consisting of all the monomials in Y of degree up to t. Recall that 
s{t) = which is the cardinality of mt(Y). For each j = 0,1,..., s, there exists 

a positive semidefinite matrix Zj € such that crj{Y) = mk-dj (Y)'^- 

Zj ■ rrik-djiY). For each a £ we can find a matrix Cj^a € Rs{k-dj)xs{k-dj) 
such that the coefficient of ajgj equals {Zj,Gj^a) for each j = 0,1,..., s. Let 

b(Y) = ^ baY'^ and ai(Y) = ^ f = l,...,m. 


aGN" 


aGP 


Then (3.3) can be written as the SDP problem 


pT = inf c^x 


^2k- 


S.t. ^ XiQ^^a +ba = '^{Zj,Cj^a), ^Ct € N 2 
i=l j=0 

It follows that 

Theorem 3.2. If Q{G) is Archimedean and Slater condition holds for the LSIPP 


problem (1.1), then decreasingly converges to p* as k ^ oo. 


Next we derive the dual problem of (3.3). Let z = (zct)ctGN 5 j^ G (^*(2^) be a trun¬ 
cated moment sequence up to order 2k. Inen it is easy to check that the moment 
matrix Mk{z) and the localizing moment matrix Mk-dj{gjz) can be represented as 

Mk{z) = ^ ZaGo^a and Mk-dj{gjz) = ^ ZaC^a, j = , S. 

ctGNr. aGN" 


Then, the Lagrangian dual of the SDP problem (3.3) is the moment problem 


(3.4) 


pT^ := sup - 


S.t. Oi^aZa = Ci, f = 1, . . . , m, 

aGNJ^ 

Mk{z) P 0, (gjz) h 0, j = 1,..., s. 

By the ‘weak duality’, we have 

Theorem 3.3. If Q{G) is Archimedean and Slater condition holds for the LSIPP 


problem (1.1), then pff°'^ decreasingly converges to p* as k ^ oo. 
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Proof. By the ‘weak duality’ and Theorem 3.2 it suffices to prove that > p* 
for each k > dp. Consider the Haar dual problem (2.1) of (1.1). Since S is 
compact and Slater condition holds for (1.1), by Proposition 2.2 p* = d* and d* 


is attainable. Denote (A*)y^s as an optimizer of d* and S* as the finite subset 
of S such that A* > 0 for every y £ S* . Let z = ^yC'^k.y where f 2 k,y is 

the Zeta vector of y up to degree 2k. Clearly, z is feasible for (3.4) and then 
pmom > _ baZa = d* = p*. Hence, we obtain that p* as A: —> oo. □ 

Remark 3.4. Since S is compact, we can define another dual problem [ni 111130 ] 
of (fTIi 


(3.5) 


sup - / b{y)dfj.{y) 

AtGM+(S) JS 

■t. / ai{y)dp{y) = a, i = 1,... ,m, 

Js 


where M^(S) is the space of all nonnegative bounded regular Borel measure on S. 
Since S is compact, as shown in |55], the dual problems (|2.1|) and (13.5^ have the 


same optimal value. By Putinar’s Positivstellensatz (part (ii) of Theorem 2.4), a 


moment sequence z has a representing measure p with support contained in S if 
Mfc(z) ^ 0, Mkigjz) hO, j = l,...,s, fc = 0,1,.... 


Therefore, (|3.4[) can be regarded as the fc-th SDP relaxation of (3.5). 


□ 


3.1.2. Optimality certificate. By the ‘weak duality’, the moment hierarchy (3.4) is 


tighter than (3.3). Moreover, (3.4) can be easily implemented and solved by the 


software GloptiPoly m developed by Henrion and Lasserre. We now propose a 
stopping criterion for (3.4) when the finite convergence occurs. Recall the notation 


in (3.21. Let k > dp. 


Condition 3.5. For an optimizer z* of the k-th SDP relaxation (3.4), the following 
condition : 


e N s.t. dp<t<k and rankMt_dg (z*) = rankMt( 2 :*) 


holds. 


This condition can be used for certifying the finite convergence of Lasserre’s SDP 
relaxations |12j of polynomial optimization problems [HiiaEi]. 

Theorem 3.6. Suppose that Q{G) is Archimedean and Slater condition holds for 
the LSIPP problem _(1Tt1)- If Condition |3.5| holds for an optimizer z* of the k-th 
SDP relaxation (|3.4[) , then p™°™ = p*. 


Proof. By Theorem 3.3 it suffices to show that p'fi°’^ < p*. Let r = lankMt^z*). 


By H Theorem 1.1], z* has a unique r-atomic measure supported on S, i.e., there 
exist r positive real numbers Ai,..., Ar and r distinct points vi,... ,Vr £ S such 
that 

= AiC2fc,i;i + ■ ■ ■ + ^rC2k,VrJ 

where C 2 k,vi is the Zeta vector of Vi up to degree 2k. By (|3.4[), we have 


Pk 


= - '^Xib{vi) 
2=1 


and c = Xia{vi). 
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For any feasible point x of ( |1.1[ ), we have 

r r 

(3.6) (Fx = ^ \a{vi)^x > - X! = VT^- 

2—1 2—1 

The inequality is due to the feasibility of x. Hence, we have < p*. □ 

Remark 3.7. (i) The extraction procedure of the r points Vi in the above proof 
can be found in [9] and has been implemented in GloptiPoly. It can be inferred from 
(3.6 1 that the points vi,... ,Vr belong to the active index set of every minimizer x* 
of the LSIPP problem (O- 

(ii) Note that Condition |3.5| is only a sufficient condition which means that 
it might not hold when the finite convergence happens. Indeed, we will see in 
Section 1^ that when applying (3.3) and (3.4) to the LSIPP problems reformulated 
from polynomial optimization problems, we can get their classic Lasserre’s SDP 
relaxations whose finite convergence can be certified by Condition |3.5[ Therefore, 
[13 Example 6.24] shows that Condition |3. 5 1 is only sufficient not necessary. □ 


3.1.3. Numerical experiments. The following are some testing examples which are 
implemented with MATLAB R2013a with two 3.60C cores and 12C RAM. We use 


CloptiPoly to manipulate the moment relaxation (3.4) and call the SDP solver Se- 


DuMi [31] in CloptiPoly to solve the resulting SDP prob lems. The desired accuracy 
in SeDuMi is set to 10“®. For checking Condition |3.5| and extracting the r points 


in the proof of Theorem 3.6 the singular value decomposition is used in CloptiPoly 
with accuracy set to 10“^. The consumed computer time is calculated as the total 
time of all relaxations from the order k = dp to the order when Condition |3.5| is 
satisfied. The results show that Condition |3.5| holds for almost all examples. 


Example 3.8. Consider the following optimization problem 

7 


inf 

xGR’’ 


s.t. 


Xi 

h * 

2=1 


2=0 


>0, V2/e[0,i]. 


This problem was studied in |3] and has an optimal solution of —1.78688. We have 
dp = 4. Computing the relaxations (3.4) with CloptiPoly, Condition 3.5 holds at 
the order fc = 4 with p™™ = —1.7869. By Theorem 3.6 the finite convergence 
occurs and ^ 4 '°™ equals the optimal value. Here is a small numerical error due to 
the computations with finite precision in Matlab. The consumed computer time is 
0.13 seconds. □ 

Example 3.9. Consider the optimization problem 

inf X 2 


s.t. xiyi +X2-y2>0, Vy e S, 


where 


S:={yGR^\ (yi + - (vl + vlf > 0} 

which is the gray region in Figure Ceometrically, the problem is to minimize the 
y 2 -intercept of the line lx{y) ■= Xiyi + X 2 — y 2 = 0 lying above S. From Figure 
we can see that the optimum is reached when the line lx{y) is simultaneously 
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Figure 1 . The semialgebraic set S in Example |3.9| and the optimal 
line (y) = 0. 


tangent at two different points of S. 
line is 

iy) — 

and the two tangent points are 


It can be checked that the optimal tangent 


12/1 


125 

l04 


- 2/2 


(3.7) 


625 1875 3375 375 A 

2704 2704^ ’ 2704 2704^ J 

625 1875 ^ 3375 375 A 

2704 ~ 2704'^ ’ 2704 ~ 2704^^ J 


(1.4322,1.4884), 

(-0.9699,1.0079). 


Hence, the optimum is ^ « 1.2019. We have dp = 2. Compute the relaxations 
(3.4) with GloptiPoly. We get = 1.2982 and = 1.2019. Condition 3.5 
holds at the order k = 3 and the extracted active index set, which corresponds 
to the set of points (3.7), consists of (1.4321,1.4883) and (—0.9699,1.0079). The 
consumed computer time is 0.24 seconds. □ 


Example 3.10. Now we test the performance of the SDP relaxation (3.4) on some 
random LSIPP problems which are generated as follows. 

Let S = [—2, 2]". Randomly pick m distinct points ..., uA) from S whose 
coordinates are integers drawn from the discrete uniform distribution on [—2,2]. 
Let ai(y),..., am(Y) be the Lagrange interpolation polynomials at these m points, 
i.e., for each and j ^ z, randomly choose an index kij £ {1 ,... ,n} for which 


and define 




A, 


„ 0 ) 




— V 


U) 


i = 1,... ,m. 


Then, we have 0 ^( 1 ;^®^) = 1 and = 0 for each j ^ i. Recall that for any t gN, 

mt{Y) denotes the column vector consisting of all the monomials in Y of degree 
up to t and s{t) denotes its cardinality. Let N be an s{t) x s{t) matrix containing 
random elements drawn from the standard uniform distribution on the open interval 
(0,1). Define b{Y) = {N-mt{Y))'^{N■mt{Y)) + l. For each z = 1,..., m, also choose 
Ci from the standard uniform distribution on the open interval (0,1). We add an 
redundant inequality ||F||| < 4rz in the description of S to make the Archimedean 
property hold. 
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Table 1. Computational results for random LSIPP problems 


No. 

(to, n, t) 

inst. 

certi. 

order (min, max) 

time (min, max) 

1 

(5, 3, 2) 

20 

20 

2 

3 

0.28s 

0.65s 

2 

(6, 3, 2) 

20 

20 

3 

4 

0.38s 

0.98s 

3 

(7, 3, 2) 

20 

20 

3 

4 

0.41s 

1 .11s 

4 

(8, 3, 2) 

20 

20 

4 

4 

0.69s 

0.83s 

5 

(9, 3, 2) 

20 

20 

4 

5 

0.78s 

2.83s 

6 

(10, 3, 2) 

20 

20 

5 

6 

1 .88s 

7.61s 

7 

(11, 3, 2) 

20 

20 

5 

6 

1.90s 

8.69s 

8 

(12, 3, 2) 

20 

15 

6 

6 

5.63s 

32.93s 

9 

(5, 4, 2) 

20 

20 

2 

3 

0.38s 

0.98s 

10 

(5, 5, 2) 

20 

20 

2 

3 

0.51s 

2.38s 

11 

(5, 6, 2) 

20 

20 

2 

3 

0.76s 

7.41s 

12 

(5, 7, 2) 

20 

20 

2 

3 

1 .22s 

30.42s 

13 

(5, 8, 2) 

20 

20 

2 

3 

2 .11s 

254.31s 

14 

(5, 4, 3) 

20 

20 

3 

3 

0.92s 

1 .10s 

15 

(5, 4, 4) 

20 

20 

4 

4 

4.35s 

5.29s 

16 

(5, 4, 5) 

20 

20 

5 

5 

23.50s 

30.07s 

17 

(5, 4, 6) 

20 

20 

6 

6 

144.16s 

185.98s 


For the class of random LSIPP problems constructed above, we can see that the 
Slater condition holds if we let a; = 0. Moreover, for each i = 1,... ,to, we have 
Xi > —b{vi) — 1 for every feasible point x S M™. Therefore, the optimum p* > —oo. 
Hence, all assumptions needed for the convergence of the SDP relaxations (3.3) and 


(3.4) are satisfied. 


We test several groups of the above random LSIPP problems with the SDP re¬ 
laxations (3.4) from the order k = dp to the order k = 8. The results are shown 


in Table [T where the inst. column denotes the number of randomly generated in¬ 
stances and the certi. column denotes the number of instances where certified finite 
convergence occurs, i.e.. Condition |3.5| holds at some order. Among all instances 
of each group, the min (max) order column shows the minimal (maximal) order of 


relaxations when Condition 3.5 is satisfied and the min (max) time column shows 
the minimal (maximal) consumed computer time. □ 

Remark 3.11. As a summary, compared with the existing methods in the litera¬ 
ture applied to the LSIPP problems our SDP relaxations approach of ( |3.3[ ) 

and (3.4) has the following properties: (a) A decreasing sequence of upper bounds 
of p* can be computed by solving a sequence of SDP problems; (b) The global 
convergence is guaranteed under some mild assumptions (Theorem |3.2| and 3.3). 
Hence, by combining the lower bounds of p* gained by, for instance, discretization 
methods, a desired e-optimal solution of ([TtJ can be obtained, (c) A checkable 
sufficient condition is available for certifying the finite convergence of the SDP re¬ 
laxations when it occurs (Theorem |3.6[ ); (d) Obviously, the sizes of the resulting 
SDP problems grow exponentially as the number of parameters and the order in¬ 
crease. Thus, our SDP relaxation method is more suitable for small or medium size 
LSIPP problems. 
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Figure 2. The semialgebraic set S in Example |3.12| and the tan¬ 
gent line l 3 / 2 {y) = 0. 


3.2. Noncompact case. In this section, we consider the LSIPP problem (1.1) 


with noncompact index set S. Since the Archimedean property is violated in this 


case, the optima of the SDP relaxations (3.3) and (3.4) might not converge to p*. 
We illustrate it by the following example. 


inf 

a;GR 


-- s.t. (1 - 3i/2)ai-b 3?/i > 0, Vy G 5, 


Example 3.12. Consider the LSIPP problem 
(3.8) 
where 

S' := {y G I j/i > 0, yj - > 0} 

which is the gray shadow below the right half of the cusp as shown in Figure 
Since (0,0) G S, a feasible x must be nonnegative. Clearly, a; = 0 is a feasible 
point. When cc > 0, the constraint in (3.8) means that S lies in the half plane 


defined hy Ix{y) '■= yi — yxjx — \ jZ < 0. Hence, the optimum is attained when the 
line lx{y) = 0 is tangent to S. It is easy to check that the feasible set is [0, 3/2] and 
the optimum is —3/4. The tangent line l 3 / 2 {y) = 0 is shown red in FigureThe 
Slater condition holds for any point x G (0, 3/2). 

Let G := {Yi, Then, Q{G) is not Archimedean since S is noncompact. 

For any fc G N, we know from [SJ Example 2.10] that (1 — 312 ) 2 ; -I- 3yi G Qk{G) if 
and only if cc = 0, i.e., = 0 for each k > dp. Now we show that for 

each k > dp. In fact, for the SDP relaxation (3.4) of the problem (3.8), let /i be a 


probability measure with uniform distribution in the following subset of S: 

Si ■= {(yi,j/ 2 ) G 1 1 < yi < 2 , 0 < 2/2 < 1} 

and be the truncated moment sequence with represe ntin g measure p up to order 
2k. It can be verified that is a feasible point of (3.4) and its corresponding 


truncated moment matrix and localizing moment matrices are positive definite since 
Si has nonempty interior. Then follows by the conic duality theorem. 

Hence, both SDP relaxations (3.3) and (3.4) do not converge to the optimum. □ 


In [33], we used the technique of homogenization to convert a general SIPP 
problem with noncompact index set into compact case. In the following, we apply 


this technique to (1.1). 


For a polynomial f{Y) G 


denote its homogenization by /^(Y) G 


where Y = (Yq, Yi,..., Y„), i.e., f’^{Y) = Yg ^/(Y/Yq), Dj = deg(f). For the 
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basic semialgebraic set S in (1.1), define 

5> := {y e K”+^ I 5^(y) >0, . .., > 0 , yo > 0, ||y||2 = 1 }, 

S:={yG K”+i I 5i"(y) > 0, ..., 5,"(y) > 0, yo > 0, ||y||^ = 1}. 


(3.9) 


Proposition 3.13. [521 Proposition 4.2] For any f{Y) G R[P], f{y) > 0 on S if 
and only if f'^{y) > 0 on closure(S'>). 

Define 

CO := niax{deg(ai),..., deg(a m): deg(6)}. 

We homogenize the polynomials OifY), i = 1,... ,m, and b{Y) to the same degree to 
and still denote the resulting polynomials as a^{Y) and b^{Y) for simplicity. Denote 


‘(F) = (a5‘(F),..., a^(Y)). It follows that the problem (1.11 is equivalent to 


inf 


T 

C X 


s.t. a^{y)^x + b^{y) >0, Vy G closure(S'>). 

Replacing closure(S'>) by the basic semialgebraic set S, we get the following problem 
p* := inf 


T 

C X 


(3.10) 


s.t. a'‘(y)'^a: + &'‘(y) > 0, Vy G S'. 


It is obvious that p* > p* since closure(S>) C S. 

For any polynomial /(F) G K[F], denote /(F) as its homogeneous part of the 
highest degree. Define 

(3.11) S := {y G M" I yi(y) > 0,... ,ys(y) > 0, ||y||2 = 1}. 

Specially, denote di{Y), t = 1,..., m, and biY) as the homogeneous parts of ai(F), 
i = 1,... ,m, and 6(F) of the same degree w. Let a(F) ;= (ai(F),..., am(F)). 


Condition 3.14. For any e > 0, there exists a feasible point o/ (1.11 sueh that 
— p* < s and a(y)^x^®^ + 6(y) >0, Vy G S. 


Theorem 3.15. p* = p* if and only if Condition\37lf\ holds for (jl.lj). 
Proof. By Proposition 


3.13 


and the fact that S\closure(S>) C {0} x S, it is straight¬ 
forward to verify the conclusion. □ 

Definition 3.16. [22] We say that S is closed at oo «/closure(S>) = S. 

Remark 3.17. Clearly, p* = p* when S is closed at oo. Note that not every set S 


of form (1.2) is closed at oo even when it is compact [201 Example 5.2]. However, 
it is shown in |33l Theorem 4.10] that the closedness at oo is a generic property. 
Namely, if we consider the space of all coefficients of generators gj’s of all possible 
sets S of form (1.2) in the canonical monomial basis of ^[F]^, coefficients of gj’s of 


those sets S which are not clos ed at oo ar e in a Zariski closed set of the space. It 
follows that the problems (1.1) and (3.10) are equivalent in general. Note that iS'> 


depends only on S, while S depends not only on S but also on the choice of the 
inequalities yi(y) > 0,... ,ys(y) > 0. In some cases, we can add some redundant 
inequalities in the description of S to force it to be closed at oo [5]. 
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Next we construct the corresponding SDP relaxations (3.31 and (3.4) of the 


problem ( |3.10| ). Let 

(3.12) l!?||^ - 1, 1 - ||?||^} 


and denote Q(G^) as the quadratic module of S' generated by G^. Then (3.3) 
becomes 


(3.13) 


pr := inf X 

-.hiv\T 


s.t. ^{YYx + b^^iY) e Qk{GY- 


For k gN, denote s{k) := Let z := ( 25 )^gjj..+i S be a truncated 

moment sequence up to order 2k whose elements are indexed by (n + l)-tuples 
a := (ao, cti, ■ ■ - jCtn) G Let 

bYY)= Y. and a^{Y)= ^ a^^YY t = 1,... ,m. 

“ 6 N -+1 aGNJ+i 

According to (3.4), the dual of ( 3.13| ) is 


(3.14) 


pT’" ■= sup 

ZGN-+1 

S.t. 


- Y ^5^5 

Mkiz) h 0, Mk-dYa’jY ^0: j = 

Mk-AYoz) h 0, Mk-iii\\Y\\l - l)z) = 0. 


Condition 3.18. There exists a point x G R”^ o/(l.l) such that a{y)^x + b{y) > 0 
for all y G S and a{y)'^x + b{y) > 0 for all y G S. 


Proposition 3.19. Slater condition holds for (3.10) if and only if Condition 3.18 
holds for 


Proof. Suppose Condition 3.18 holds for (1.1) at x. For any v = (vo,v) G S, we 


have u G S if Uq = 0 and v/vq G S otherwise. It is straightforward to verify that 
Slater condition also holds for ( |3.10 ) at x. 

Suppose that Slater condition holds for (3.10) at a; G R”^. For any point u G R", 


we have (0, u) G S if u G S and 


it implies that Condition 3.18 holds for (1.1) at x. 


Vi+lhlli ’ yi+Nl 


G S if u G S. Then similarly, 

□ 


Theorem 3.20. If Condition 3.1^ holds for (1.1), then bothjT^’" andpff°'^ decreas- 
ingly converge to p* as k ^ oo. Moreover, they both converge to p* if S is closed 
at 00 or Condition\3.14 holds for (|1.1[). 


Proof. Since Q{G^) is Archimedean, the conclusion follows by combining Theorem 
|3.2[ |3.3| |3.15| and Proposition |3.19[ □ 
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Example |3.12| continue. By definition, we have 

s > = {(2/0,2/1, 2/2) e 1 2/1 > 0 , 2/02/1 -2/2 > 0 , 2/0 > 0 , 

s = {(2/0,2/1,2/2) e 1 2/1 > 0 , 2/02/1 - yl >^, 2/0 > 0 , 

S = {(2/1,2/2) e 1 2/1 > 0,2/2 < 0,2/1 +2/1 = !}■ 


= 1 }, 
= 1 }, 


After homogenization, the problem (3.8) is reformulated as 


(3.15) inf -- s.t. (2/0 - 31/2)3: + 32/1 > 0, Vy = (2/0,2/1,2/2) e S', 

tcGM Z 

Note that S is closed at 00 . In fact, for every (0 ,di,i; 2) G S\S>, let 

■= I p 7,1 \ i 


:= e, vi, 


Then ll 2 }e>o C S> and lim£_>.o II 2 = (0,wi,n2). Hence, we have 

S\S> C closure(S>) and S is closed at 00 . It is easy to check that Condition 
g holds for ( |3T^ if we let a; = 1. Hence, the assumptions in Theorem |3.20 
are satisfied. With GloptiPoly, we get the following numerical results: = 

— 1.2124 X 10“® and = —0.7500. Condition 


3.5 


is satisfied for A: = 3 and 


we obtain the certified optimum —0.7500. As noted in Remark 3.7 the extracted 
numerical active index set of the minimizer x* = 3/2 is (0.5773,0.5774,0.5774) 
which corresponds to (1,1) G S where the line lx* (y) = 0 is tangent to S. □ 


(4.1) 


4. Special case: polynomial optimization problems 
Consider the general polynomial optimization problem 
f f* := inf f(y) 

\ s.t. gi{y)>0,...,gs{y)>0. 


Recall that the feasible set of (4.1) is denoted as S. We assume that —00 < f* < 00 . 


The problem (4.1) can be reformulated as an LSIPP problem 


(4.2) 


— f* = inf —X s.t. f{y) — x > 0, Wy G S. 


As we will see, by applying the SDP relaxation approach derived in Section to 
the special LSIPP problem (4.2), we can obtain: 


(i) the classic Lasserre’s SDP relaxation method m of ( |4.1[ ) when S is compact, 
which can be expected from the way of reformulation (4.2) and relaxation 


(3.1); 


(ii) a new and efficient hierarchy of SDP relaxations of (4.1) when S is noncom¬ 
pact and / is stably bounded from below on S, which is a class of polynomial 
optimization problems studied in [IS]. Note that the classic Lasserre’s SDP 


relaxation method might fail for this kind of problems, see Example 4.6 


4.1. Compact case. We first assume that S is compact. In the special LSIPP 


(4.2), we have 


m = I, a{Y) = —I, b{Y) = fiY) and c = —1. 
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(4.1) 


According to (|3.3[ ) and ( |3.4[ ), by exchanging of ‘inf’ and ‘sup’, we obtain SDP 
relaxations of i 


/r := sup X 


(4.3) 


and 


s.t. f(Y) - X = J2^jiY)gj{y), 
j=o 

go = 1, cTj G S^, degiajgj) <2k, i = 0, 


:= inf 

2gR<.(2fe) 


(4.4) 


^ ) fa^a 
S.t. Zo = 1, 

Mkiz) h 0, Mk-dj{gjz) ^0, j = 1, 

where zq denotes the element of z indexed by the n-tuple (0,..., 0). They are just 
the classic Lasserre’s SDP relaxations of polynomial optimization problems m- 
Clearly, Slater condition holds for (4.2) if and only if / is bounded from below on 


. .,s. 


S. Hence, by Theorem 3.2 and Theorem 3.3 when Q{G) is Archimedean, both 


and /^°™ converge to /* as k oo, which has already been proved in m Theorem 
4.2]. 

Note that by Remark |3.7|the points in the active index set of the minimizer of 


(4.2) extracted when Condition 3.5 is satisfied are just the global minimizers of 


(4.1). 


4.2. Noncompact case. Now we consider the polynomial optimization problem 


(4.1) with noncompact feasible set S. After homogenization, the problem (4.2) 


becomes 


(4.5) 


/* := sup X 

xGR 


s-t. f^iy) - xy^ ^ >0,Vy€ S, 


where Df = deg(/). According to (3.3) and (3.4), we obtain a hierarchy of SDP 
relaxations of (14.51): 


(4.6) 


fr ■■= sup X 


aiGlE 


S.t. f\Y)-xYo^f G QkiG'^), 


where is defined in (3.12). For A: € M, denote s{k) := Let ^ := 

(Za) 


5GN, 


H G 


be a truncated moment sequence of degree 2k. Denote zof.o 
as the element of z indexed by the {n + l)-tuple (D/, 0,..., 0). The dual problem 
of (4.6|) is 


(4.7) 


/r°” := inf 

2GR>(='=) 


E 


S.t. ZDj:,o = l,Mk{z) y 0,Mk-iiYoz) y 0, 
Mk-d^{gjz) h 0, j = l,...,s, 
Mfc_i((|iy||2-l)z)=0. 
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Definition 4.1. [18] We say that f is stably bounded from below on S if f remains 
bounded from below on S for all sufficiently small perturbations of the coefficients 
of f,9i, ■■■,9s- 


Recall the notation f{Y) and S defined in (3.11). 


Proposition 4.2. The following conditions are equivalent: 

(i) / is stably bounded from below on S; 

(ii) / is strictly positive on S; 

(hi) Slater condition holds for (4.5). 

Proof. By [T^ Theorem 5.1 and 5.3], (i) / is stably bounded from below on S if 
and only if the function max{—gi,..., —fs, /} is strictly positive on the unit sphere, 
which is equivalent to (ii). The equivalence of (ii) and (iii) follows from Proposition 

ITHI □ 



Corollary 5.4] proposed the following method. For a S N", let /„ and pj^a denote 
the coefficients of F" in / and pj, j = 1,... ,s. Fix a lower bound e > 0 of 
max{—gi,..., —gs,f} on the unit sphere. Normalize so that 0 S S' and /(O) = 0. 
Then minimizing f on S is equivalent to minimizing f on the compact set SO|u G 

M" 1 Ml < p^llhere 


Pe = max<(l, \fa\/e, Y ■ j = ^, ■ ■ ■, 

l|a||i<deg/ ||a||i<deggj 

As pointed in [B Notes 5.2], the lower bound e can be computed by solving s + 1 
polynomial optimization problems on compact semialgebraic sets and hence there 
are obvious problems with this if s is too large. As we have seen, we can instead 


equivalently reformulate (4.1) as (4.5) and solve the single optimization problem by 
SDP relaxations (4.6) and (4.7). □ 


Example 4.6. Consider the following polynomial optimization problem 


(4.8) 


92 


inf w? 


s.t. 2 /i - 1 > 0, 


91 - Myiy2 - 1 > 0 , 

9i + Myiy2 - 1 > 0, 
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Figure 3. The semialgebraic set S in Example |4.6| 


where M is a positive constant. It was shown in that the global minimizers 

and global minimum are 


± 


M + y/M^ri 


±1 


and 2 + 


M{M + y/M^ + 4) 


We consider the case when M = 1. The feasible set S is depicted in gray in Figure 
1^ The global minimizers are ±1^ « (±1.618, ±1) and its global minimum 

is 2 ± « 3.618. Because S is noncompact, by the argument in 0, the classic 

Lasserre’s SDP relaxations (4.31 of (4.8) can only provide lower bound /““ = 2 no 
matter how large the order k is. Since S has nonempty interior and the relaxation 
(4.3) of (4.8) is feasible, by [HI Theorem 4.2], equals for each k and 


therefore can not converge to the optimum as fc —>■ oo, either. 


Obviously, the condition (ii) in Proposition 4.2 holds. We compute the relax¬ 
ations (4.7) with GloptiPoly. For fc = 3, Condition 3.5 is satisfied and we get the 
numerically certified optimum f^°’^ = 3.6180. The extracted active index set is 


{(0.4653, ±0.7529, ±0.4653)} which, by Remark 4.4 provides the global minimizers 
(±1.6181,±1). □ 


5. Conclusion 

In this paper, we study a subclass of semi-infinite programming problems whose 
constraint functions are polynomials in parameters and index sets are basic semi¬ 
algebraic sets (LSIPP problems). When the index set of an LSIPP problem is 
compact, a convergent hierarchy of SDP relaxations is constructed based on Puti- 
nar’s Positivstellensatz. We extend this approach to the case when the index set 
is noncompact by the technique of homogenization. Applying our method to the 
LSIPP problem reformulated from a polynomial optimization problem, we obtain a 
new hierarchy of SDP relaxations for solving the class of polynomial optimization 
problems whose objective polynomials are stably bounded from below on noncom¬ 
pact feasible sets. 
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